---
contributors:
  - Margaret Kenney
  - John Salchak
---

## Overview

The code in this replication package analyzes the data files from the Kenney and Salchak audit experiment. The main file runs all of the code to generate the data for the 2 tables and 2 figures in the main text, as well as the two regression tables for the corresponding figure coefficient plots in the appendix. The second file produces the additional 9 tables and 2 figures in the appendix.The replicator should expect the code to run in under 10 minutes.

## Data Availability and Provenance Statements

The data was derived from an audit experiment. We sample participants in two ways. The interviews focused on how firm professionals and IO bureaucrats engage on economic issues in international organizations (Kenney 2025). We contacted tax professionals that engaged with IO bureaucrats on international taxation rules, compiling a list of those who recently submitted public comments. OECD bureaucrats were sampled via the OECD website and publications. We targeted bureaucrats that engage with non-state actors and organize public consultations. In total, we emailed 229 elites. As pre-registered, we excluded subjects if the emails did not deliver, resulting in a sample size of 173 elites. The coding guide is available at `Kenney-Salchak Coding Guide`. Please find the treatment below:

Dear [NAME],

\noindent I hope this email finds you well. My name is Mary Williams / Jake Miller, and I'm a research assistant on a University of California, Berkeley research project about public commenting at international organizations. The research team would like to feature your invaluable perspective in the study. 


\noindent Might you be willing to discuss your participation with the public commenting process in the context of a Zoom interview sometime during the next 3 weeks? If you are willing to interview, please reply and we will share a Calendly by which we can coordinate an agreeable time.


\noindent If these times don’t work for you, please reach out and I will accommodate to find a time at which our schedules sync. I would be more than happy to provide copies of my questions in advance, and/or additional information about the study. If there are others in your network that would be willing to participate, I kindly request that you share it with them.

\noindent Best wishes,

\noindent Mary Williams / Jake Miller

More information about the study processes, selection criteria, and description of data variable names can be found in the Supplementary Information for the paper.

### Statement about Rights

I certify that the author(s) of the manuscript have legitimate access to and permission to use the data used in this manuscript. 

### Summary of Availability

All data are publicly available other than confidential data, including the subjects' names and the text of their email responses. Confidential data used in this paper and not provided as part of the public replication package will be preserved for 5 years after publication, in accordance with journal policies. 

### Details on each Data Source

| Data.Name  | Data.Files | Location | Provided | Citation |
| -- | -- | -- | -- | -- | 
| “Full Results of Kenney Salchak Audit Experiment” | kenney_salchak_audit.csv | data/ | TRUE | 
| “Firm Results of Kenney Salchak Audit Experiment” | firm_sample.csv | data/ | TRUE |
| “OECD Results of Kenney Salchak Audit Experiment” | oecd_sample.csv | data/ | TRUE | 
| “First Name Trait Ratings - Elder and Hayes (2023)” | comb_traitratings.csv | data/ | TRUE | Mitchell and Hayes (2023) |
| “Last Name Trait Ratings - Elder and Hayes (2023)” | lastname_traitratings.csv | data/ | TRUE | Mitchell and Hayes (2023) |

The Elder and Hayes (2023) data used for tables 3 and 4 in the appendix were collected by the authors from the Harvard Dataverse: https://dataverse.harvard.edu/file.xhtml?fileId=6153156&version=1.0.


### Software Requirements

- R (code was last run with version 2023.12.0+369)
  - `dplyr` (version 1.1.4)
  - `ggplot2` (version 3.4.4)
  - `broom` (version 1.0.5)
  - `SentimentAnalysis` (version 1.3-5)
  - `estimatr` (version 1.0.4)
  - `stats` (version 4.3.2)
  - `modelsummary` (version 1.4.3)
  - `purrr` (version 1.0.2)
  - `tidyverse` (version 2.0.0)
  - `magrittr` (version 2.0.3)
  - `sandwich` (version 3.1-0)
  - `coefplot` (version 1.2.8)
  - `knitr` (version 1.45)
  - `xtable` (version 1.8-4)

All software packages will be loaded at the start of `code/kenney_salchak_main.rmd` and `code/kenney_salchak_appendix.rmd`


### Memory, Runtime, Storage Requirements

#### Summary

Approximate time needed to reproduce the analyses on a standard 2020 desktop machine: <10 minutes


Approximate storage space needed: 25 MB - 250 MB

#### Details

The code was last run on a i3-core Intel-based laptop with MacOS version Sonoma 14.6.1 with 200GB of free space. 

## Description of programs/code
- The program `code/kenney_salchak_main.rmd` generate all tables and figures in the main body of the article, as well as Table 5 and 6 in the Appendix. Output files are numbered as in the manuscript (`table5.tex`, `figure1.pdf`).
- The program `code/kenney_salchak_appendix.rmd` will generate all tables and figures  in the online appendix (other than Table 5 and 6).

## Instructions to Replicators

- Set the working directory in both `code/kenney_salchak_main.rmd` and `code/kenney_salchak_appendix.rmd` before running.
- Run `code/kenney_salchak_main.rmd` to replicate all figures / tables in the main text, as well as Tables 5 and 6.
- Run `code/kenney_salchak_appendix.rmd` to replicate all figures / tables in the Appendix, except Tables 5 and 6.

### Details

- ` code/kenney_salchak_main.rmd`: will create all figures / tables from the main text, as well as the regression tables that coincide with the figures (Tables 5 and 6). 
   - The programs were last run top to bottom on March 17, 2025.
   
 - ` code/kenney_salchak_main.rmd`: will create all figures / tables from the Appendix, except for the regression tables that coincide with the figures (Tables 5 and 6). 
   - The programs were last run top to bottom on March 17, 2025.

## List of tables and programs

The provided code reproduces:

Selected tables and figures in the paper, as explained and justified below.


| Figure/Table #    | Program                  | Line Number | Output file                      | Note                            |
|-------------------|--------------------------|-------------|----------------------------------|---------------------------------|
| Table 1           | code/kenney_salchak_main.rmd   |   32          | table1.tex             ||
| Table 2           |  code/kenney_salchak_main.rmd  | 196        | table2.tex                      ||
| Figure 1          |  code/kenney_salchak_main.rmd  | 130        | figure1.pdf                      ||
| Figure 2          |  code/kenney_salchak_main.rmd  | 167        | figure2.pdf                      ||
| Table 3           |  code/kenney_salchak_appendix.rmd | 48         | table3.tex                       |Source: Elder and Hayes (2023) |
| Table 4         | code/kenney_salchak_appendix.rmd          |         58    |            table4.tex                      | Source: Elder and Hayes (2023)       |
| Table 5          | code/kenney_salchak_main.rmd     |      162       | table5.tex                      ||
| Table 6         | code/kenney_salchak_main.rmd    |        192     | table6.tex          ||
| Table 7         | code/kenney_salchak_appendix.rmd    |      70       | table7.tex          ||
| Table 8        | code/kenney_salchak_appendix.rmd    |       87      | table8.tex          ||
| Table 9        | code/kenney_salchak_appendix.rmd    |       181      | table9.tex          | Confidential: exact text could identify subjects. |
| Table 10         | code/kenney_salchak_appendix.rmd    |       216      | table10.tex          ||
| Table 11         | code/kenney_salchak_appendix.rmd    |      228       | table11.tex          ||
| Table 12        | code/kenney_salchak_appendix.rmd    |        245     | table12.tex          ||
| Table 13         | code/kenney_salchak_appendix.rmd    |      249       | table13.tex          ||
| Figure 3         | code/kenney_salchak_appendix.rmd    |       136      | figure3.pdf         ||
| Table 4         | code/kenney_salchak_appendix.rmd    |       158      | figure4.pdf         ||

## References

Elder, E.M. \& Hayes, M. (2023, January). Signaling Race, Ethnicity, and Gender with Names: Challenges and Recommendations. The Journal of Politics, doi: 10.1086/723820.

---
## Acknowledgements

Some content on this page was copied from [Hindawi](https://www.hindawi.com/research.data/#statement.templates). Other content was adapted from [Fort (2016)](https://doi.org/10.1093/restud/rdw057), Supplementary data, with the author's permission.
